Skip to content

Conversation

@gyfora
Copy link
Contributor

@gyfora gyfora commented Jan 9, 2025

What is the purpose of the change

The main purpose is to allow users to easily and explicitly clear all autoscaler state and parallelism overrides.

Currently users need to toggle the autoscaler on/off to clear the parallelism settings which relies on implicit internal behaviour and is not always easy to execute safely. Unfortunately the on-off workaround requires 2 spec changes which need to be submitted carefully one after the other as the operator may only look at the 2nd one and then nothing happens.

Brief change log

  • Add autoscalerResetNonce to jobSpec
  • Tests

Verifying this change

New unit tests have been added to cover the reset logic

Does this pull request potentially affect one of the following parts:

  • Dependencies (does it add or upgrade a dependency): no
  • The public API, i.e., is any changes to the CustomResourceDescriptors: yes
  • Core observer or reconciler logic that is regularly executed: yes

Documentation

  • Does this pull request introduce a new feature? yes
  • If yes, how is the feature documented? JavaDocs

@gyfora gyfora requested review from 1996fanrui and mxm January 9, 2025 10:32
@1996fanrui 1996fanrui self-assigned this Jan 9, 2025
Copy link
Member

@1996fanrui 1996fanrui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @gyfora for the clarification, I only left one minor comment, please take a look in your free time, thanks~

@gyfora gyfora merged commit e7ce6df into apache:main Jan 13, 2025
104 of 107 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants